Embodied communication: speakers' gestures affect listeners' actions.
نویسندگان
چکیده
We explored how speakers and listeners use hand gestures as a source of perceptual-motor information during naturalistic communication. After solving the Tower of Hanoi task either with real objects or on a computer, speakers explained the task to listeners. Speakers' hand gestures, but not their speech, reflected properties of the particular objects and the actions that they had previously used to solve the task. Speakers who solved the problem with real objects used more grasping handshapes and produced more curved trajectories during the explanation. Listeners who observed explanations from speakers who had previously solved the problem with real objects subsequently treated computer objects more like real objects; their mouse trajectories revealed that they lifted the objects in conjunction with moving them sideways, and this behavior was related to the particular gestures that were observed. These findings demonstrate that hand gestures are a reliable source of perceptual-motor information during human communication.
منابع مشابه
Mental Timeline in Persian Speakers’ Co-speech Gestures based on Lakoff and Johnson’s Conceptual Metaphor Theory
One of the introduced conceptual metaphors is the metaphor of "time as space". Time as an abstract concept is conceptualized by a concrete concept like space. This conceptualization of time is also reflected in co-speech gestures. In this research, we try to find out what dimension and direction the mental timeline has in co-speech gestures and under the influence of which one of the metaphoric...
متن کاملAttentional Factors in Listeners' Uptake of Gesture Cues During Speech Processing
In conversation, speakers spontaneously produce manual gestures that can facilitate listeners' comprehension of speech. However, various factors may affect listeners' ability to use gesture cues. Here we examine a situation where a speaker is referring to physical objects in the contextual here-and-now. In this situation, objects for potential reference will compete with gestures for visual att...
متن کاملAided and unaided speech supplementation strategies: effect of alphabet cues and iconic hand gestures on dysarthric speech.
PURPOSE This study compared the influence of speaker-implemented iconic hand gestures and alphabet cues on speech intelligibility scores and strategy helpfulness ratings for 3 adults with cerebral palsy and dysarthria who differed from one another in their overall motor abilities. METHOD A total of 144 listeners (48 per speaker) orthographically transcribed sentences spoken with alphabet cues...
متن کاملSpeakers Communicate Their Perceptual-Motor Experience to Listeners Nonverbally
We explored the perceptual motor information expressed by speakers, and encoded by listeners when engaged in naturalistic communication. After solving the Tower of Hanoi task either with real objects or on a computer, speakers explained the Tower of Hanoi task to listeners. Speakers expressed properties of the objects that had been used to solve the task in their hand gestures, but not in their...
متن کاملA Model for Context-sensitive Interpretation of Communicative Feedback
A prevalent and important coordination mechanism in dialogue is communicative 'listener feedback' in form of short verbal-vocal signals (e.g., 'uh-huh', 'yeah', 'huh'), head gestures (e.g., nodding, wiggling) or facial expressions. Listeners' feedback signals are indications of their cogni-tive state and communicate whether listeners and speakers are in contact , whether listeners perceive, und...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Cognition
دوره 113 1 شماره
صفحات -
تاریخ انتشار 2009